BEST AVAILABLE COPY 



Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 




Bescheinigung Certificate 



Attestation 



Die angehefteten Unterla- 
gen stimmen mit der 
ursprunglich eingereichten 
Fassung der auf dem nach- 
sten Biatt bezeichneten 
europaischen Paten tan mel- 
dung Oberein. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les documents fixes a 
cette attestation sont 
conformes a la version 
initialement deposee de 
la demande de brevet 
europeen specifiee a la 
page suivante. 



Patentanmeldung Nr. Patent application No. Demande de brevet n° 

03103558.7 



PRIORITY DOCUMENT 

! SUBMITTED OR TRANSMITTED IN 
COMPLIANCE WITH 
RULE 17.1(a) OR (b) 



Der President des Europaischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

IB President de I'Office europeen des brevets 
p.o. 



RCvan Dijk 




Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Anmeldung Nr: 
Application no. 
Demande no: 



03103558-7 



Anmeldetag: 
Date of filing: 
Date de depot: 



25.09.03 



Anmel der/Appl 1 can t( s)/ DemandeurC s) : 

Koninklijke Philips Electronics N.V. 
Groenewoudseweg 1 
5621 BA Eindhoven 
PAYS-BAS 



Bezelchnung der Erf 1ndung/T1tle of the 1nvent1on/T1 tre de 1 - ^ventlon: 
(Falls die Bezelchnung der Erflndung nlcht angegeben 1st, slehe Beschrelbung. 
If no title is shown please refer to the description. 
SI aucun tltre n'est 1nd1que se referer a la description.) 

Motion blurring 

In Anspruch genommene PrloHat(en) / Priori ty(1es) claimed /PHorlte(s) 

revendlquee(s) , . ., ft . 

Staat/Tag/Aktenze1chen/State/Date/F1le no./Pays/Date/Numero de depot. 



Internationale Patentklasslf Ikatl on/International Patent Class1f1 
Classification Internationale des brevets: 

G06T15/00 



Am Amneldetag benannte Vertragstaaten/Contractlng states designated at d* 
flHng/Etats contractants designees lors du depSt: 

AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC 
PT R0 SE SI SK TR LI 



03103558.7 
ppA/FPn/nFR Pn^m 1(114 ? — m ?nnn 



2 



PHNL031 141EPS 



I 11.09.2003 

Motion blurring 



FIELD OF THE INVENTION 

The invention relates to a method of generating motion blur in a graphics 
system, and to a graphics computer system. 

5 BACKGROUND OF THE INVENTION 

Usually, images are displayed on a display screen of a display apparatus in 

successive frames of lines. 3D objects displayed on the display screen which move with a 
large speed have a large frame to frame displacement This is in particular the case for 3D 
games. The large displacement may lead to visual artifacts, often referred to as temporal 
10 aliasing. Temporal filtering, which adds blur to the images, alleviates these artifacts. 

An expensive approach to alleviate temporal aliasing is to increase the frame 
rate such that the motions of the objects result in smaller frame to frame displacements. 
However, a high refresh rate requires an expensive display apparatus capable to display 
images with these high refresh rates. 
15 Another approach is temporal super-sampling wherein the images are rendered 

multiple times within the frame display time interval. The rendered images are averaged and 
then displayed. This approach requires the 3D application to send the geometry for several 
instances within the frame to frame interval which requires a very powerful processing. 

A cost effective solution is to average a present image during the present 
20 frame with the previous displayed image of the preceding frame. This approach provides an 
approximation of motion blur only, it does not provide a satisfactory quality of the images. 

US-B-6,426,755 discloses a graphics system and method for performing blur 
effects. In one embodiment, the system comprises a graphics processor, a sample buffer, and 
a sample-to-pixel calculation unit The graphics processor is configured to render a plurality 
25 of samples based on a set of received three-dimensional graphics data. The processor is also 
configured to generate sample tags for the samples, wherein the sample tags are indicative of 
whether or not the samples are to be blurred. The super-sampled sample buffer receives and 
stores the samples from the graphics processor. The sample-to-pixel calculation unit receives 
and filters the samples from the super-sampled sample buffer to generate output pixels which 
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form an image on a display device. The sample-to-pixel calculation units are configured to 
select the filter attributes used to filter the samples into output pixels based on the sample 



5 SUMMARY OF THE INVENTION 

It is an object of the invention to add the blur during a rasterization operation 

with a one-dimensional filter. 

A first aspect of the invention provides a method of generating motion blur in 
a graphics system as claimed in claim 1 . A second aspect of the invention provides a 
10 computer graphics system as claimed in claim 14. Advantageous embodiments are defined in 

the dependent claims. 

— irtheweth-odofg^^ 



wito the first aspect of the invention, geometrical information defining a shape of a graphics 
primitive is received, this geometrical information may be the three-dimensional graphics 
15 data referred to inUS-B-6,426,755. It is also possible to use two-dimensional graphics data 
which is supplied by an application in a system which has less processing recourses. The 
method uses displacement information determining a displacement vector defining a 
direction of motion of the graphics primitive to sample the graphics primitive in the direction 
of the motion to obtain input samples. A one dimensional spatial filtering of toe input 
20 samples provides the temporal filtering. In tMsn^r a WghquaUty blur is obtamed without 
requiring complex processing and filtering. 

A simple one dimensional filter is used without requiring redundant 
calculations. In contrast, the post-processing of US-B-6,426,755 has to calculate atwo- 
dimensional filter with a per pixel varying direction and amount of filtering. The approach in 
25 accordance with Ihe invention has the advantage that sufficient motion blur is introduced in 
an effective manner. It is not required to increase the frame rate, nor to increase the temporal 
sample rate, the quality of the images is better than obtained by the prior art averaging. 

A further advantage is that this approach can be implemented in the well 
known inverse texture mapping approach as claimed in claim 6, and in the forward texture 
30 mapping approach as claimed in claim 7. The known inverse mapping approach and the 
forward texture mapping approach as such will be elucidated in more detail wife respect to 
Figures 2 and 4. 

In an embodiment in accordance with the invention as defined in claim 2, the 
footprint of the one-dimensional filter varies with the magnitude of the displacement vector 
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and thus with the motion. This has Ihe advantage that the amount of blur introduced is 
correlated with the amount of displacement of a graphics primitive. If a low amount of 
movement is present, only a low amount of blur is introduced and a high amount of sharpness 
is preserved. If a high amount of movement is present, a high amount of blur is introduced to 
suppress the temporal aliasing artifacts. Thus, an optimal amount of blur is provided. It is 
easy to vary the amount of filtering because a one-dimensional filter is required only. 

In an embodiment in accordance with the invention as defined in claim 3, the 
displacement vector is supplied by the 2D (two-dimensional) or 3D (three-dimensional) 
application which, for example, is a 3D game. This has the advantage that the programmers 
of the 2D or 3D application have full control over the displacement vector and thus can steer 
the amount of blur introduced. 

In an embodiment in accordance with the invention as defined in claim 4, the 
2D or 3D application provides information which defines the position and the orientation of 
the graphics primitives during a previous frame. The method of generating motion blur in 
accordance with an embodiment of the invention determines the displacement vector of the 
graphics primitives by comparing the position and the orientation of the graphics primitives 
in the present frame with the position and the orientation of the graphics primitives of the 
previous frame. This has the advantage that the displacement vectors do not have to be 
calculated by the 3D application in software, but instead the geometry acceleration hardware 
can be used for determining the displacement vectors. 

In an embodiment in accordance with the invention as defined in claim 5 , the 
buffering of the position and the orientation of the graphics primitives during the previous 
frame is performed by the method of generating motion blur in accordance with the 
invention. This has the advantage that a standard 3D application can be used, the 
displacement vectors are completely determined by the method of generating motion blur in 
accordance with the invention. 

In an embodiment in accordance with the invention as defined in claim 6, the 
method of generating motion blur is implemented in the well know inverse texture mapping 
approach. 

The intensities of the pixels present in the screen space define the displayed 
image on the screen. Usually, the pixels are actually positioned (in a matrix display) or 
thought to be positioned (in a CRT) in an orthogonal matrix indicated by an orthogonal x and 
y coordinate system. In the embodiment in accordance with the invention as defined in claim 
6, the x and y coordinate system is rotated such that the screen displacement vector in the 
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screea space occurs in the direction of the x-axis. Therefore, the sampling is performed in the 
screen space in the direction of the screen displacement vector. The graphics primitive in the 
screen space is the real world graphics primitive mapped (also referred to as projected) to the 
rotated screen space. Usually, the graphics primitive is a polygon. The screen displacement 
5 vector is the displacement vector of the eye space graphics primitive mapped to the screen 
space. The eye space graphics primitive is also referred to as the real world graphics 
primitive, which does not indicate mat a physical object is meant, also synthetic objects are 
covered. The sampling provides coordinates of the resampled pixels which are used as input 
samples for the inverse texture mapping, instead of the coordinates of the pixels in the non- 

1 0 rotated coordinate system. 

Then, the well known inverse texture mapping is applied. A blurring-fflter 

wfrmhas^fbotptiM 

wilhin the footprint will be filtered in accordance with the blurring-filter amplitude 
characteristics. The footprint in the screen space is mapped to the texture space and called the 
15 mapped footprint Also the polygon in the screen space is mapped to the texture space and 
called the mapped polygon. The texture space comprises the textures which should be 
displayed on the surface of the polygon. These textures are defined by texel intensities stored 
in a texture memory. Thus, the textures are appearance information which defines an 
appearance of Ihe graphics primitive by defining texel intensities in a texture space. 
20 The texels both railing within the mapped footprint and within the mapped 

polygon are determined, the mapped blurring-filter is used to weight the texel intensities of 
these texels to obtain the intensities of the pixels in the rotated coordinate system (thus, the 
intensities of the resampled pixels instead of the intensities of the pixels in the well known 
inverse texture mapping wherein the coordinate system is not rotated). 
25 The one-dimensional filtering averages the intensities of the pixels in the 

rotated coordinate system to obtain averaged intensities. A resampler resamples the averaged 
pixel intensities of 1he resampled pixels to obtain the intensities of the pixels in the original 
non-rotated coordinate system from the averaged intensities. 

In an embodiment in accordance with the invention as defined in claim 7, the 
30 method of generating motion blur is implemented in the forward texture mapping approach. 

In the texture space the texel intensities of the graphics primitive in the texture 
space are resampled in the direction of a texture displacement vector to obtain resampled 
texels (RTi). The texel displacement vector is Ihe real world displacement vector mapped to 
the texel space. The texel intensities, which are stored in a texture memory, are interpolated 
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to obtain the intensities of the resampled texels. The one-dimensional spatial filtering 
averages the intensities of the resampled texels in accordance with a weighting function to 
obtain filtered texels. The filtered texels of the graphics primitive are mapped to the screen 
space to obtain mapped texels. The intensity contributions of a mapped texel to all the pixels 
5 of which a corresponding pre-filter footprint of a pre-filter covers the mapped texel is 
determined. The contribution of a mapped texel to a particular pixel depends on the 
characteristic of the pre-filter. For each pixel, the intensity contributions of the mapped texels 
are summed to obtain the intensity of each one of the pixels. 

Thus, said in other words, the coordinates of texels within the polygon in 
10 texture space are mapped to the screen space, and a contribution from a mapped texel to all 
the pixels of which the corresponding pre-filter footprint covers this texel is determined in 
accordance with the filter characteristic for this texel, and finally all the contribution of the 
texels are summed for each pixel to obtain the pixel intensity. 

In an embodiment in accordance with the invention as defined in claim 8, the 
15 displacement vector of the graphics primitive is determined as an average of the displacement 
vectors of vertices of the graphics primitive. This has the advantage that only a single 
displacement vector for each polygon is required, which displacement vector can be 
determined in an easy manner. It suffices if the directions of the displacement vectors of the 
vertices is averaged. The magnitude of the displacement vector may be interpolated over the 
20 polygon. 

In an embodiment in accordance with the invention as defined in claim 9, the 
intensities of the resampled pixels are distributed, in the screen space, in a direction of the 
displacement vector in the screen space over a distance determined by a magnitude of the 
displacement vector to obtain distributed intensities. The overlapping distributed intensities 

25 of different pixels are averaged to obtain a piece-wise constant signal which is the averaged 
intensity in screen space. This has the advantage that a shutter behavior of a camera is 
resembled, thus providing a very acceptable motion blur. 

In an embodiment in accordance with the invention as defined in claim 10, the 
the intensities of the resampled texels are distributed, in the texture space, in a direction of 

30 the displacement vector in the texture space over a distance determined by a magnitude of the 
displacement vector to obtain distributed intensities. The overlapping distributed intensities 
of different resampled texels are averaged to obtain a piece-wise constant signal which is the 
averaged intensity in the texture space (also referred to as filtered texel). This has the 
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advantage that a shutter behavior of a camera is resembled, thus providing a very acceptable 
motion blur. 

In an embodiment in accordance with the invention as defined in claim 1 1, the 
one-dimensional spatial filtering applies different weighted averaging functions during one or 
5 more frame-to-frame intervals. This has the advantage that although in each frame an 

efficient one-dimensional filter is performed, a higher-order temporal filtering is obtained. At 
me rendering of the frame, only partial intensities of the pixels are calculated which have to 
be stored. The pixel intensities of n successive frames have to be accumulated to obtain the 
correct pixel intensities. In this case, n is the width of the temporal filter. The higher-order 
10 filtering provides less aliasing with a same amount of blur, or, equivalent^, a reduced blur 
with the same amount of temporal aliasing. 

~m airemboxlimentm-accor 



distance over which the resampled pixels or the resampled texels are distributed is rounded to 
a multiple of the distance between resampled texels. This avoids a doubling of the number of 

15 resampled texels during the accumulation of the distributed intensities of the texels. 

These and other aspects of the invention are apparent from and will be 
elucidated with reference to the embodiments described hereinafter. 

In an embodiment in accordance to the invention as defined in claim 13, the 
motion vector now is subdivided in segments. In the embodiment in accordance with the 

20 invention as defined in claim 10, the intensities of the resampled texels are distributed, in me 
texture space, in a direction of the displacement vector in the texture space over a distance 
determined by a magnitude of the displacement vector to obtain distributed intensities. The 
overlapping distributed intensities of different resampled texels are averaged to obtain a 
motion blurred texture which is a piece-wise constant signal. Wherein the displacement 

25 vector is valid for a complete frame, and thus the motion blur is introduced in images 

rendered at a frame rate. 

The motion vector of the embodiment defined in claim 13 is subdivided in 
segments which are associated with sub-displacement vectors, one for each segment, and thus 
the motion blur is introduced in images rendered at a higher fiame rate determined by the 
30 number of segments in a frame period. In fact a frame rate up-conversion is reached. Now, 
the frame period is sub-divided in a number of sub-frames which is equal to the number of 
segments. Thus, instead of the single frame, several sub-frames are rendered on the basis of a 
single sampling of the 3D model including the displacement information covered by the 
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motion vector. The blur size of objects within these sub-frames may be shortened according 
to the frame rate up conversion. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 In the drawings: 

Fig. 1 elucidates a display of a real world 3D object on a display screen, 

Fig. 2 elucidates the known inverse texture mapping, 

Fig. 3 shows a block diagram of a circuit for performing the known inverse 

texture mapping, 
l0 Fig. 4 elucidates the forward texture mapping, 

Fig. 5 shows a block diagram of acircuit for performing the forward texture 

mapping, 

Fig. 6 shows a block diagram of a circuit in accordance with an embodiment 
of the invention, 

15 pig. 7 elucidates the sampling in the direction of the displacement vector in the 

screen space, 

Fig. 8 shows a block diagram of a circuit in accordance with an embodiment 
of the invention comprising the inverse texture mapping, 

Fig. 9 elucidates the sampling in the direction of the displacement vector in the 

20 texture space, 

Fig. 10 shows a block diagram of a circuit in accordance with an embodiment 
of the invention comprising forward texture mapping, 

Fig. 1 1 shows an embodiment of a blurring filter with a footprint, 
Fig. 12 shows the determination of a displacement vector of a polygon based 
25 on the displacement vectors of vertices of the polygon, 

Fig. 13 shows the temporal pre-filtering using stretched pixels in accordance 

with an embodiment of the invention. 

Fig. 14 shows the temporal pre-filtering using stretched texels in accordance 

with an embodiment of the invention, 
30 pig. 15 shows the approximation of motion blur of a camera by using the 

stretched texels in accordance with an embodiment of the invention, 

Figs. 16 show schematicaUy that it is possible to sub-divide the frame period 

in sub-frame periods, and 



10 
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Fig. 17 shows a block diagram of a circuit in accordance with an embodiment 
of the invention comprising the forward texture mapping combined with frame rate up- 
conversion. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Fig. 1 elucidates a display of a real world 3D object on a display screen. A real 
world object WO, which may be a three-dimensional object such as the cube shown, is 
projected on a two-dimensional display screen DS. The three-dimensional object WO has a 
surface structure or texture which defines the appearance of the three-dimensional object 
WO. In Fig. 1 the polygon A has a texture TA and the polygon B has a texture TB. The 
polygons A and B are with a more general term also referred to as the real world graphics 



The projection of the real world object WO is obtained by defining an eye or 
camera position ECP with respect to the screen DS. In Fig. 1 is shown how the polygon SGP 
15 corresponding to the polygon A is projected on the screen DS. The polygon SGP in the 
screen space SSP defined by the coordinates X and Y is also referred to as a graphics 
primitive instead of the graphics primitive in Ihe screen space. Thus, with graphics primitive 
is indicated the polygon A in the eye space, or the polygon SGP in me screen space, or the 
polygon TGP in the texture space, it is clear from the context which graphics primitive is 
20 meant It is only the geometry of the polygon A which is used to determine the geometry of 
the polygon SGP. Usually, it suffices to know the vertices of the polygon A to determine the 

vertices of the polygon SGP. 

The texture TA of the polygon A is not directly projected from the real world 
into the screen space SSP. The different textures of the real world object WO are stored in a 

25 texture map or texture space TSP defined by the coordinates U and V. For example, Fig. 1 
shows that the polygon A has a texture TA which is available in the texture space TSP in the 
area indicated by TA, while the polygon B has another texture TB which is available in the 
texture space TSP in the area indicated by TB. The polygon A is projected on the texture 
space TA such that a polygon TGP occurs such that when Ihe texture present within the 

30 polygon TGP is projected on the polygon A the texture of the real world object WO is 
obtained or at least resembled as much as possible. A perspective transformation PPT 
between the texture space TSP and the screen space SSP projects the texture of the polygon 
TGP on the corresponding polygon SGP. This process is also referred to as texture mapping. 
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Usually, foe textures are not all present in a global texture space, but every texture defines its 
own texture space. 

Fig. 2 elucidates the known inverse texture mapping. Fig. 2 shows the polygon 
SGP in the screen space SSP and the polygon TGP in the texture space TSP. To facilitate the 
elucidation, it is assumed that both the polygon SGP and the polygon TGP correspond to the 
polygon A of the real world object WO of Fig. 1 . 

The intensities PH of the pixels Pi present in me screen space SSP define the 
image displayed. Usually, the pixels Pi are actually positioned (in a matrix display) or 
thought to be positioned (in a CRT) in an orthogonal matrix of positions. In Fig. 2 only a 
limited number of the pixels Pi is indicated by the dots. The polygon SGP is shown in the 
screen space SSP to indicate which pixels Pi are positioned within the polygon SGP. 

The texels or texel intensities Ti in the texture space TSP are indicated by the 
intersections of the horizontal and vertical lines. These texels Ti which usually are stored in a 
memory called texture map define the texture. It is assumed that the part of the texel map or 
texure space TSP shown corresponds to the texture TA shown in Fig. 1. The polygon TGP is 
shown in the texture space TSP to indicate which texels Ti are positioned within the polygon 
TGP, Ihese texels Ti are indicated by small crosses. 

The well known inverse texture mapping comprises the steps elucidated in Ihe 
now following. A bluring-filter which has a footprint FP is shown in the screen space SSP 
and has to operate on the pixels Pi to perform a weighted averaging operation required to 
obtain the blurring. This footprint FP in the screen space SSP is mapped to the texture space 
TSP and called the mapped footprint MFP. The polygon TGP which may be obtained by 
mapping foe polygon SGP firom the screen space SSP to foe texture space TSP is also called 
foe mapped polygon. The texture space TSP comprises foe textures TA TB (see Fig. 1) 
which should be displayed on the surface of foe polygon SGP. As described above, these 
textures TA TB are defined by texel intensities Ti stored in a texel memory. Thus, foe 
textures TA TB are appearance information which define an appearance of foe graphics 
primitive SGP by defining texel intensities Ti in a texture space TSP. 

The texels Ti both falling within foe mapped footprint MFP and within foe 
mapped polygon TGP are determined. These texels Ti are indicated by the crosses. The 
mapped blurring-filter MFP is used to weight foe texel intensities Ti of these texels Ti to 
obtain foe intensities of foe pixels Pi. 

Fig. 3 shows a block diagram of a circuit for performing foe known inverse 
texture mapping. The circuit comprises a rasterizer RSS which operates in foe screen space 
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SSP, a resampler RTS in the texture space TSP, a texture memory TM and a pixel fragment 
processing circuit PFO. Ut, Vt is the texture coordinate of a texel Ti with index t, Xp, Yp is 
the screen coordinate of a pixel with index p, It is me color of the texel Ti with index t, and Ip 
is the filtered color of pixel Pi with index p. 

5 The rasterizer RSS rasterizes Ihe polygon SGP in the screen space SSP. For 

every pixel Pi traversed, its blurring filter footprint FP is mapped to Ihe texture space TSP. 
The texels Ti within the mapped footprint MFP and within the mapped polygon TGP are 
determined and weighted according to a mapped profile of the blurring filter. The color of the 
pixels Pi is computed using the mapped blurring filter in Ihe texture space TSP. 

10 Thus, the rasterizer RSS receives the polygons SGP in the screen space SSP to 

supply the mapped blurring filter footprint MFP and the coordinates of the pixels Pi. A 

-res^lerinlhcrte^ 

information on the position of the polygon TGP to determine which texels Ti are within me 
mapped footprint MFP and within the polygon TGP. The intensities of the texels Ti 

15 determined in this manner are retrieved from the texture memory TM. The blurring filter 

filters the relevant intensities of the texels Ti determined in mis manner to supply the filtered 

color Ip of toe pixel Pi. 

The pixel fragment processing circuit PFO provides an improved processing 
of pixels near to borders of the polygon SGP and supplies the pixel intensities Pli of the 
20 pixels Pi displayed on the screen DS. The pixel fragment processing circuit PFO blends the 
blur if several polygons are moving. 

Fig. 4 elucidates forward texture mapping. Fig. 4 shows the polygon SGP in 
the screen space SSP and the polygon TGP in the texture space TSP. To fecilitate me 
elucidation, it is assumed that both the polygon SGP and the polygon TGP correspond to the 
25 polygon A of the real world object WO of Fig. 1. 

The intensities PH of the pixels Pi present in the screen space SSP define me 
image displayed. The pixels Pi are indicated by the dots. The polygon SGP is shown in the 
screen space SSP to indicate which pixels Pi are positioned within the polygon SGP. The 
pixel actually indicated by Pi is positioned outside the polygon SGP. With each pixel Pi a 
30 footprint FP of a blur filter is associated. 

The texels or texel intensities Ti in the texture space TSP are indicated by the 
interstices of the horizontal and vertical lines. Again, these texels Ti which usually are stored 
in a memory called texture map define the texture. It is assumed that the part of the texel map 
or texure space TSP shown corresponds to the texture TA shown in Fig. 1 . The polygon TGP 
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is shown in the texture space TSP to indicate which texels Ti are positioned within the 
polygon TGP. 

The coordinates of the texels Ti within the polygon TGP are mapped 
(resampled) to toe screen space SSP. In Fig. 4, this mapping (indicated by the arrow AR from 
the texture space TSP to the screen space SSP) of a texel Ti (indicated by a cross in the 
texture space) to the screen space SSP provides mapped texels MTi (indicated by the cross in 
the screen space SSP, which cross may be positioned in-between pixel positions indicated by 
the dots) in the screen space SSP. A contribution of the mapped texel MTi to all die pixels Pi 
which have a footprint FP of the blur filter which encompases the mapped texel MTi is 
determined in accordance with the filter characteristic of the blur filter. All the contributions 
of the mapped texels MTi to the pixels Pi are summed to obtain the intensities PK of me 
pixels Pi. 

Li the forward texture mapping, the resampling from the colors of the texel Ti 
to the colors of the pixels Pi occurs in the screen space SSP, and thus is input sample driven. 
Compared to the inverse texture mapping, it is easier to determine which texels Ti contribute 
to a particular pixel Pi. Only the mapped texels MTi which are within a footprint FP of the 
blurring filter for a particular pixel Pi will contribute to the intensity or color of this particular 
pixel Pi. Further, there is no need to transform the blurring filter from the screen space SSP to 

the texel space TSP. 

Fig. 5 shows a block diagram of a circuit for perfonning the forward texture 
mapping. The circuit comprises a rasterizer RTS which operates in the texture space TSP, a 
resampler RSS in the screen space SSP, a texture memory TM and a pixel fragment 
processing circuit PFO. Ut, Vt is the texture coordinate of a texel Ti with index, Xp, Yp is the 
screen coordinate of a pixel with index p, It is the color of the texel Ti with index t, and rp is 
the filtered color of pixel Pi with index p. 

The rasterizer RTS rasterizes the polygon TGP in the texture space TSP. For 
every texel Ti which is within the polygon TGP, the resampler in the screen space RSS maps 
the texel Ti to a mapped texel MTi in the screen space SSP. Further, the resampler RSS 
determines the contribution of a mapped texel MTi to all the pixels Pi of which the associated 
footprint FP of die blurring filter encompasses this mapped texel MTi. Finally, the resampler 
RSS sums the intensity contributions of all mapped texels MTi to the pixels Pi to obtain the 
intensities Pli of die pixels Pi. 
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The pixel fragment processing circuit PFO provides an improved processing 
of pixels near to borders of the polygon SGP and supplies the pixel intensities PB of the 
pixels Pi displayed on the screen DS. 

Fig. 6 shows ahlock diagram of a circuit in accordance with an embodiment 
5 of the invention. This motion blur generating circuit comprises a rasterizer RA, a 
displacement providing circuit DIG, and a one-dimensional filter ODF. 

The rasterizer RA receives both geometrical information GI which defines the 
shape of a graphics primitive SGP or TGP and displacement information DI which 
determines a displacement vector defining a direction of the motion of the graphics primitive 
10 SGP or TGP. The rasterizer RA samples Ihe graphics primitive SGP or TGP in the direction 

of the displacement vector to obtain samples RPi. The one-dimensional filter ODF provides a 
-femprmriffe^terin^^ 



The rasterizer RA may operate in the screen space SSP or in die texture space 
TSP. If the rasterizer RA operates in the screen space SSP, the graphics primitive SGP or 
1 5 TGP may be the polygon SGP, and the samples RPi are based on the pixels Pi. If the 

rasterizer RA operates in Ihe texture space TSP, the graphics primitive SGP or TGP may be 
the polygon TGP, and the samples RPi are based on the texels Ti. 

The use of a rasterizer RA in the screen space SSP is elucidated with respect to 
Fig. 7 and with respect to its combination with the inverse texture mapping (see Fig. 8). 
20 * The use of a rasterizer RA in the texture space TSP is elucidated with respect 

to Fig. 9 and with respect to its combination with the forward texture mapping (see Fig. 10). 

Fig. 7 elucidates the sampling in the direction of the displacement vector in the 
screen space. The real world object WO moves in a certain direction. This movement of the 
complete object WO causes the graphics primitives (the polygons A and B) to move also. 
25 The movement of the polygon A can be indicated in the screen space SSP by the 

displacement vector SDV of the polygon SGP. Other polygons of the real world object WO 
may have other displacement vectors. The intensities PB of the pixels Pi are resampled such 
mat resampled pixels RPi are determined which are positioned in a rectangular grid of which 
one direction coincides with the direction of the displacement vector SDV. The 
30 indicated by dots, the resampled pixels RPi are indicated by crosses. Only a few pixels Pi and 
resampled pixels RPi are shown. 

The pixels Pi of which the intensities PB determine the image displayed are 
positioned in the orthogonal coordinate space defined by the orthogonal axis x and y. The 
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resampled pixels RPi are positioned in the orthogonal coordinate space defined by the 

orthogonal axis x' and y'. 

Fig. 8 shows a block diagram of a circuit in accordance with an embodiment 

of the invention comprising the inverse texture mapping. 

The sampler RSS, which is the sampler RA shown in Fig. 6 which samples in 
the screen space SSP, samples within a polygon SGP in me direction of the displacement 
vector SDV of this polygon SGP to obtain resampled pixels RPi. Therefore, the sampler RSS 
receives the geometry of the polygon SGP and the displacement information DI from the 
displacement providing circuit DIG. The displacement information DI may comprise the 
direction in which the displacement occurs and the amount of displacement and thus may be 
the displacement vector SDV. The displacement vector SDV maybe supplied by the 3D 
application, or may be determined by the displacement providing circuit DIG from the 
position of the polygon A in successive frames. The resampled pixels RPi occur in an 
equidistant orthogonal coordinate space of positions which are aligned with the displacement 
vector SDV. Or said differently, the coordinate system x, y in the screen space is rotated such 
that a rotated coordinate system x', y' is obtained of which the x' axis is aligned with the 
displacement vector. 

The inverse texture mapper ITM receives the resampled pixels RPi to supply 
intensities Rip. The inverse texture mapper ITM operates in the same manner as the well 
known inverse texture mapping as elucidated with respect to Figs. 2 and 3. But, instead of the 
coordinates of the pixels Pi, the coordinates of the resampled pixels RPi are used Thus, the 
footprint FP of the filter in the screen space is now defined in the coordinate system which is 
aligned with the screen displacement vector. This footprint is mapped to the texture space 
where the texels within both this mapped footprint and within the polygon ore weighted 
according to the mapped filter characteristics to obtain the intensity of the resampled pixel 
Rip to which the footprint belongs. 

The one-dimensional filter ODF comprises an averager AV and a resampler 
RSA. The averager AV averages the intensities Rip to obtain averaged intensities ARIp. The 
averaging is performed in accordance with a weighting function WF. The resampler RSA 
resamples the averaged intensities ARIp to obtain the intensities PH of the pixels Pi. 

Fig. 9 elucidates the sampling in the direction of the displacement vector in the 
texture space. The real world object WO moves in a certain direction. This movement of the 
complete object WO causes the graphics primitives (the polygons A and B) to move also. 
The movement of the polygon A can be indicated in the texture space TSP by die 
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displacement vector TDV of Hie polygon TGP. Other polygons of the real world object WO 
may have other displacement vectors. The intensities of the texels Ti are resampled such that 
resampled texels RTi are obtained which are positioned in a matrix of which one direction 
coincedents with the direction of the displacement vector TDV. The texels Ti are indicated 
5 by dots, the resampled texels RTi are indicated by crosses. Only a few texels Ti and 
resampled texels RTi are shown. 

The texels Ti of which the intensities determine the texture displayed are 
positioned in the orthogonal coordinate space defined by the orthogonal axis U and V. The 
resampled texels RTi are positioned in toe orthogonal coordinate space defined by the 
10 orthogonal axis U' and V. A distance DIS between two samples (texels Ti) in the texture 

space is indicated by DIS. 

Fi^ H)^) Wa blo^ 

of the invention comprising the forward texture mapping. 

The sampler RTS, which is the sampler RA shown in Fig. 6 which samples in 
15 the texture space TSP, samples within a polygon TGP in the direction of the displacement 
vector TDV of this polygon TGP to obtain the resampled texels RTi. Therefore, the sampler 
RTS receives the geometry of toe polygon TGP and the displacement information DI from 
toe displacement providing circuit DIG. The displacement information DI may comprise the 
direction in which the displacement occurs and toe amount of displacement and thus may be 
20 the displacement vector TDV. The displacement vector TDV maybe suppliedby the 3D 
application, or may be determined by the displacement providing circuitDIG from the 
position of the polygon A in successive frames. 

The interpolator IP interpolates the intensities of the texels Ti to obtain the 

intensities Rli of the resampled texels RTi. 
25 The one-dimensional filtering ODF comprises an averager AV which averages 

toe intensities Rli in accordance with a weighting function WF to obtain filtered resampled 
texels FTi to which is also referred as filtered texels FTi. 

The mapper MSP maps the filtered texels FTi within the polygon TGP (in 
more general also referred to as the graphics primitive) to the screen space SSP to obtain the 

30 mapped texels MTi (see Fig. 4). 

The calculator CAL determines the intensity contributions of each of the 
mapped texels MTi to each of the pixels Pi of which a corresponding pre-filter footprint FP 
ofapre-filter PRF (see Fig. 1 1) covers one of the mapped texels MTi. The intensity 
contributions depend on toe characteristics of toe pre-filter PRF. For example, if the pre-filter 
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has a cubic amplitude characteristic and if a mapped texel MTi is very near to a pixel Pi, the 
contribution of mis mapped texel MTi to the intensity of the pixel Pi is relatively large. If the 
mapped texel is at the horder of the footprint FP of the prefilter which is centered at a pixel 
Pi, the contribution of me mapped texel MTi is relatively small. If the mapped texel MTi is 
5 not wifoto foe footprint FP of the prefilter of a particular pixel Pi, this mapped texel MTi will 
not contribute to die intensity of the particular pixel Pi. 

The calculator CAL sums all the contribution of the different mapped texels 
MTi to me pixels Pi to ohtain the intensities PH of the pixels Pi. The intensity PH of a 
particular pixel Pi only depends on the intensities of the mapped texels MTi within the 
10 footprint FP helonging to mis particular pixel Pi and the amplitude characteristic of the pre- 
filter. Thus for a particular pixel Pi only the contributions of the mapped texels MTi within 
die footprint FP helonging to this particular pixel Pi need to he summed. 

Fig. 1 1 shows an embodiment of a hlurring filter with a footprint The hlurring 
filter (also referred to as pre-filter) PKF, which in Fig. 1 1 filters in the screen space SSP, has 
15 a footprint FP. The footprint FP is the area of the filter PKF in the x and/or y direction in 

which a mapped texel MTi contributes to a pixel Pi. The filter PKF is shown for a pixel Pi at 
a position Xp in the screen space SSP. In the example of the filter PKF shown, the footprint 
FP is four pixel distances wide and covers in the x-direction the positions Xp-2, Xp-1, Xp, 
Xp+1, Xp+2. A mapped texel MTi which is mapped at the position Xm will contribute to the 
20 pixel Pi at the position Xp with the intensity of the mapped texel MTi multiplied with the 
filter value COl. 

Fig. 12 shows the determination of a displacement vector of a polygon hased 
on the displacement vectors of vertices of the polygon. The polygon SGP in the screen space 
SSP has vertices VI, V2, V3, V4 to which the displacement vectors TDV1, TDV2, TDV3, 

25 TDV4, respectively, are associated. Preferably, the displacement vector TDV for all the 

pixels Pi within the polygon SGP is the average of the displacement vectors TDV1, TDV2, 
TDV3, TDV4. Thus, the displacement vectors TDV1, TDV2, TDV3, TDV4 are vectorially 
added to ohtain both the direction and the amplitude (after division by the number of 
vertices) of the displacement vector TDV. 

30 More complex approaches are possible, for example, if the displacement 

vectors TDV1, TDV2, TDV3, TDV4 are largely different, the polygon may be divided in 
smaller polygons. 

Fig. 13 shows foe temporal pre-filtering using stretched pixels in accordance 
with an embodiment of the invention. The one-dimensional filter ODF is performed by first 
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<ftstributing the intensities Rip of fee resampled pixels RPi in the direction of the 
displacement vector SDV. The distribution of the intensity Rip is performed in an area 
around the associated resampled pixel RPi such that the local intensity Rip is spread out over 
this area. The dimensions of the area are determined by the magnitude of the displacement 
vector SDV. This spreading out of the intensity Rip is also referred to as stretching the pixels 
Pi. As an example only, Fig. 13 shows a motion displacement which is 3.25 times the 
distance between two adjacent resampled pixels RPi. The pixel stretching in the x' direction 

(see Fig. 7) is elucidated. 

In Fig. 13A, the intensities Rip of the resampled pixels RPi are distributed or 
stretched as indicated by the horizontal lines indicated by DE. Each dot on the x'-axis 
indicates fee position of a resampled pixel RPi. The lines Dli show that fee intensity Rip of 
- erabTorae^sampleti^ 



bofe at fee left hand side and at fee right hand side of each of fee resampled pixels RPi. 

Fig. 13B shows fee average of fee overlapping distributed intensities Dli. 
Fig. 14 shows fee temporal pre-filtering using stretched texels in accordance 
wife an embodiment of fee invention. The one-dimensional filter ODF is performed by first 
distributing fee intensities Rli of fee resampled texels RTi in fee direction of fee 
displacement vector TDV. The distribution of fee intensity Rli is performed in an area around 
fee associated resampled texel RTi such feat fee local intensity Rli is spread out over this 
area. The dimensions of fee area are determined by fee magnitude of fee displacement vector 
TDV. This spreading out of fee intensity Rli is also referred to as stretching fee resampled 
texels RTi. As an example only, Fig. 14 shows a motion displacement which is 3.25 times fee 
distance between to adjacent resampled texels RTi. The texel stretching in fee U' direction 

(see Fig. 9) is elucidated. 

In Fig. 14A, fee intensities Rli of fee resampled texels RTi are distributed or 
stretched as indicated by fee horizontal lines indicated by TDK, for clarity only a few of these 
lines are shown, and different lines have a small ofiset to be able to distinguish them from 
each other. Each dot on fee U'-axis indicates fee position of a resampled texel RTi. The lines 
TDK show feat fee intensity RE of each of fee resampled texels RTi is distributed to cover 
anofeer one of resampled texels RTi bofe at fee left hand side and at fee right hand side of 
each one of fee resampled texels RTi. 

Fig. 14B shows fee average FTi of the overlapping distributed intensities TDB. 

The stretched texels are overlapping if fee motion displacement during fee 
frame sample interval is larger than fee distance between two adjacent resampled texels RTi. 
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The piece-wise constant signal FTi which is obtained by averaging the overlapping parts of 
the distributed intensities TDIi is a good approximation of the time-continue integration of a 
camera as will be explained with respect to Fig. 1 5. Thus, the result of the texel stretching is 
a blur which resembles the blur of a traditional camera. This blur is very acceptable to a 
viewer. If the stretched texels are not overlapping due to no or a small amount of motion, no 
motion blur is generated and a spatial box reconstruction is applied. 

Fig. 14 illustrates the averaging of the overlapping parts of the distributed 
intensities Dli for a motion displacement of 3.25 times the mapped texel distances. The 
obtained piece-wise constant signal FTi is an approximation of an integrated signal. It is 
possible to view the piece-wise constant signal FTi as a box reconstruction of artificial 
samples that represent the averaged overlapping parts. The artificial samples depend on a 
varying number of overlapping stretched texels. In Fig. 14, either three or four stretched 
texels overlap. This can be avoided by restricting the edges of the stretched texels to the 
resampled or mapped texel positions RTi. Thus, a motion blur factor is used which is an 
integer multiple of the distance between resampled texels RTi. 

Fig. 1 5 shows the approximation of motion blur of a camera by using the 
stretched texels in accordance with an embodiment of the invention. Fig. 1 5A shows a texel 
stretching of eight mapped texel distances. The line indicated by tb shows the positions of the 
resampled texels RTi in the U' direction for a particular frame. Hie line indicated by te 
shows the positions of the resampled texels RTi in the IT direction for a frame succeeding 
the particular frame. The distributed intensities RH are indicated by the lines TDIi. The 
resulting piece-wise constant intensity FTi is shown in Fig. 15B. The solid lines indicated by 
CA show the motion blur introduced by a camera. 

With respect to both Figs. 13 and 14, the 3D application may provide the 
motion blur vectors per vertex. The motion blur vectors indicate the displacement of the 
vertex from a previous 3D geometry sample instant tb to the current 3D sample instant te (see 
Figs. 15 and 16. Alternatively, the 3D application may provide information which allows 
determining the motion blur vectors which are also referred to as the displacement vectors 
TDV. The footprint or the filter length of the one dimensional filter ODF is associated with 
the whole or a fraction of the shutter open (or exposure) interval of a normal movie camera. 
By varying the exposure time and thus the filter footprint, the number of resampled texels 
RTi which are within the filter footprint and thus the amount of averaging performed by the 
filter ODF is varied In this manner it is possible to compromise between the amount of blur 
versus the amount of temporal aliasing. For example, to mimic a camera with an exposure 
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time of one tenth of me fiame period te-tb the footprint of the (spatial) filter ODF is related to 
mis fraction of the frame period. In Fig. 15 the exposure time is equal to the frame period and 
thus the full displacement vector TDV between me two frames is used to obtain the motion 
blurred piece-wise constant intensity FTi. 
5 Figs. 1 6 show schematically that it is possible to sub-divide the frame period 

in sub-frame periods. 

Fig. 16A shows the intensity Rli of the resampled texels RTi at the instant to 
of a first fiame. The resampled texels RTi extend in the direction of the movement U' of the 
vertex and are indicated on the U' axis with equidistant spaced dots. In this example, me 
10 intensity Rli of me resampled texels RTi is 100% from position pi to p2, and 0% for other 

positions. 

Fig? 1^ showlhe-mtensi^ 



30 



of a second frame which immediately succeeds the first frame. The resampled texels RTi 
extend in the direction of the movement U' of the vertex and are indicated on the U' axis 
15 with equidistant dots. In this example, the intensity Rli of the resampled texels RTi is 100% 
from position p5 to p6, and 0% for other positions. Thus, from the first fiame to the second 
frame, the texel intensities are moved from position pi to position p5 as indicated by the 

displacement vector TDV. 

Fig. 16C is a combined representation of Figs. 16A and 16B. Now, the vertical 
20 axis represents the time while the intensity Rli of the resampled texels RTi is indicated by a 
thick non-dashed line WH if the intensity is 100% or by a dashed line BL if the intensity is 
0%. The resampled texels RTi are not explicitly indicated from Fig. 16C onwards, but might 
occur at the same positions as shown in Figs. 16A and 16B. The period of time between the 
occurrence of the first and the second frame is indicated by the frame period TFP, which 
25 more precisely is the frame repetition period. Fig. 16C is in fact similar to Fig. 15A. 

Fig. 16D shows schematically the motion blurred texels FTi, in case of non- 
frame-rate-up conversion also referred to as the piece wise constant signal FTi. The same 
signal together with the more detailed piece wise constant signal FTi is shown in Fig. 15B. 
With respect to Figs. 15 it is described how this piece wise constant signal FTi is obtained by 
averaging the "stretched" intensities RE of the resampled texels RTi. The amount of 
stretching depends on the magnitude of the displacement vector TDV and the shutter open 
interval selected for the whole frame. 

Fig. 16E is a same representation as Fig. 16C. Now, by way of example, the 
frame period TFP is sub-divided in two sub-frame periods TSFP1 and TSFP2. It is of course 
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possible to sub-divide lie frame period TFP in more than two sub-frame periods. The first 
sub-frame TSFP1 starts at tb and ends at tm = (to -He) / 2. The second sub-frame TSFP2 
starts at tm and lasts until te. 

It is assumed tbat the speed of movement is constant, thus the displacement 
vector TDV is now sub-divided in a first displacement vector TDVS1 and a second 
displacement vector TDVS2. The magnitude of each of these two sub-divided displacement 
vectors TDVS1, TDVS2 is half the magnitude of the displacement vector TDV. If the motion 
speed is not constant and/or the motion path is in different directions the two sub-divided 
displacement vectors TDVS1, TDVS2 may have different magnitudes and/or directions. 

At an assumed linear movement, at the instant tb, the resampled texels RTi 
have the 100% intensity WH from the positions pi to p2, at the instant tm, the resampled 
texels RTi have the 100% intensity WH from the positions p3 to p4, and at the instant te, the 
resampled texels RTi have the 100% intensity WH from the positions p5 to p6. At the other 
positions the intensity RK is 0% as indicated by BL. 

Fig. 1 6F shows the filtered texels FTi for the first sub-frame TSFP1. The one- 
dimensional filtering ODF is again performed by averaging the "stretched" intensities Rfi of 
the resampled texels RTi as elucidated with respect to Figs. 16C and 16D, wherein now the 
amount of stretching depends on the magnitude of the sub-displacement vector TDVS1. 
Again, as in Fig. 16D only the envelope of the piece wise constant signal FTi is shown. 

Fig. 16G shows the filtered texels FTi for the second sub-frame TSFP1. The 
one-dimensional filtering ODF is again performed by averaging the "stretched" intensities 
Rli of the resampled texels RTi as elucidated with respect to Figs. 16C and 16D, wherein 
now the amount of stretching depends on the magnitude of the sub-displacement vector 
TDVS2. Again, as in Fig. 16D only the envelope of foe piece wise constant signal FTi is 
shown. 

The result of sub-dividing foe displacement vector TDV in a number of sub- 
displacement vectors or segments TDVS1, TDVS2, is that foe frame rate of providing foe 
intensities Pfi of foe pixels Pi (see Figs. 10 and 17) supplied to foe display screen increases. If 
foe displacement vector TDV is sub-divided in N sub-displacement vectors TDVS1, TDVS2, 
instead of one frame (TFP), N sub-frames (TSFP1, TSFP2) are provided and the frame rate 
of foe displayed information increases with a factor N. These N sub-frames are rendered 
based on a single sampling of foe 3D model mcluding foe information to determine foe 
displacement vectorrs TDVS1, TDVS2. The blur size of objects within foe sub-frames 
(TSFP1, TSFP2) is shortened according to foe frame rate up -conversion fector N. 
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Fig. 17 shows a block diagram of a circuit in accordance with an embodiment 
of the invention comprising the forward texture mapping which generates two motion blurred 
sub-frames on the basis of a single sampling of the geometry including motion data. Fig. 17 
which shows a circuit to obtain a frame rate up-conversion fector of 2 is based on the block 
diagram shown in Fig. 10 wherein the averager AV, the mapper MSP and the calculator CAL 
are provided two times to be able to supply the pixel intensities two times per frame. More in 
general, if a frame rate up-conversion wife an integer fector N is desired, N averagers AV, 
mappers MSP and calculators CAL are provided in parallel. Alternatively, fee same single 
averager AV, mapper MSP and calculator CAL as shown in Fig. 10 may be used which are 
fest enough to sequentially determine fee pixel intensities N times per frame. A combination 
of both these solutions is also possible. 

The-opei^OT-offee-^^ 

following. The sampler RTS samples within a polygon TGP in fee direction of fee 
displacement vector TDV of this polygon TGP to obtain fee resampled texels RTi. Therefore, 
15 fee sampler RTS receives fee geometry of fee polygon TGP and fee displacement 

information DI from fee displacement providing circuit DIG. The displacement information 
DI may comprise fee direction in which fee displacement occurs and fee amount of 
displacement and feus may be fee displacement vector TDV. The displacement vector TDV 
may be supplied by the 3D application, or may be determined by fee displacement providing 
20 circuit DIG from fee position of fee polygon A in successive frames. The interpolator IP 

interpolates fee intensities of fee texels Ti to obtain fee intensities Rli of fee resampled texels 
RTi. 

In fee first branch fee one-dimensional filtering ODF comprises an averager 
AVa which averages the intensities Rli in accordance wife a weighting function WF to obtain 

25 filtered resampled texels FTia to which is also referred as filtered texels FTia. The mapper 

MSPa maps fee filtered texels FTia within fee polygon TGP to the screen space SSP to obtain 
fee mapped texels MTia (see Fig. 4). The calculator CALa determines fee intensity 
contributions of each of fee mapped texels MTia to each of fee pixels Pi of which a 
corresponding pre-filter footprint FP of a pre-filter FRF (see Fig. 1 1) covers one of fee 

30 mapped texels MTia. The intensity contributions depend on fee characteristics of fee pre- 
filter PRF. For example, if the pre-filter has a cubic amplitude characteristic and if a mapped 
texel MTia is very near to a pixel Pi, fee contribution of this mapped texel MTi to fee 
intensity of fee pixel Pi is relatively large. If fee mapped texel is at fee border of fee footprint 
FP of fee prefilter which is centered at a pixel Pi, fee contribution of fee mapped texel MTia 
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is relatively small. If the mapped texel MTia is not within the footprint FP of the prefilter of a 
particular pixel Pi, this mapped texel MTia will not contribute to the intensity of the 
particular pixel Pi. The calculator CALa sums all the contribution of the different mapped 
texels MTia to the pixels Pi to obtain the intensities PEa of the pixels Pi. The intensity PKa of 
a particular pixel Pi only depends on the intensities of the mapped texels MTia within the 
footprint FP belonging to this particular pixel Pi and the amplitude characteristic of the pre- 
filter. Thus for a particular pixel Pi only Ihe contributions of the mapped texels MTia within 
the footprint FP belonging to this particular pixel Pi need to be summed 

In the second branch the one-dimensional filtering ODF comprises an averager 
AVb which averages the intensities PJi in accordance with a weighting function WF to obtain 
filtered resampled texels FTib to which is also referred as filtered texels FTib. The mapper 
MSPb maps the filtered texels FTib within the polygon TGP to the screen space SSP to 
obtain the mapped texels MTib. The calculator CALb determines the intensity contributions 
of each of Ihe mapped texels MTib to each of the pixels Pi of which a corresponding pre- 
filter footprint FP of a pre-filter PRF (see Fig. 1 1) covers one of me mapped texels MTib in 
the same manner as elucidated with respect the the calculator CALa. 

To conclude, in a preferred embodiment, the invention is directed to a method 
n f n «,prrt;ni. motion Wnr in a 3D-eranhics svstem. A geometrical information GI defining a 
shape of a graphics primitive SGP or TGP is received RSS; RTS from a 3D-apphcation. A 
displacement vector SDV; TDV defining a direction of motion of the graphics primitive SGP 
or TGP is also received from the 3D-application or is determined from the geometrical 
information. The graphics primitive SGP or TGP is sampled RSS; RTS in the direction 
indicated by the displacement vector SDV; TDV to obtain input samples RPi, and an one 
dimensional spatial filtering ODF is performed on the input samples RPi to obtain temporal 
pre-filtering. 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the scope of the appended claims. For example, in 
many of the embodiments above, the processing of only one polygon is elucidated. In a 
practical application a huge amount of polygons (or more general: graphics primitives) may 
have to be processed for a complete image. 

In the claims, any reference signs placed between parenthesis shall not be 
construed as limiting the claim. The word "comprising" does not exclude the presence of 
other elements or steps than those fisted in a claim. The invention can be implemented by 
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means of hardware comprising several distinct elements, and by means of a suitably 
programmed computer. In the device claim enumerating several means, several of these 
means can be embodied by one and the same item of hardware. 
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CLAIMS: 



1 . A method of generating motion blur in a graphics system, the method 
comprising: 

receiving (RA; RSS; RTS) geometrical information (GI) defining a shape of a 

graphics primitive (SGP,TGP), 
5 providing (DIG) displacement information (DI) determining a displacement 

vector (SDV;TDV) defining a direction of motion of the graphics primitive (SGP; TGP), 

sampling (RA; RSS; RTS) the graphics primitive (SGP; TGP) in the direction 
indicated by the displacement vector (SDV;TDV) to obtain input samples (RPi; Rli), and 
one dimensional spatial filtering (ODF) of the input samples (RPi; RE) to 
10 obtain temporal pre-filtering. 

.-i i i • j • i _4.~ni« din ohm nf nrranHi'nai /TIT^ 

2. a memoa as ciauucu m vuuui i, wum«u ~^ ■ — o v ✓ 

displacement information (DI) further defines an amount of motion of the graphics primitive 
(SGP; TGP), and wHerein tne step oi one aimensiumu spauai iuiwiu 5 v^^ 7 *~ 

15 obtain the temporal pre-filtering with a size of a filter footprint (FP) that depends on the 
magnitude of the displacement vector (SDV;TDV). 

3. A method as claimed in claim 1, wherein the displacement vector (SDV;TDV) 
is supplied by a 2D or a 3D applicatioru 



25 



4 b a method as claimed in claim 1, wherein the step of providing (DIG) 

displacement information (DI) receives a model-view transformation matrix from a 2D or a 
3D application, said matrix defining the position and orientation of the graphics primitive 
(SGP; TGP) of a previous frame. 

5. a method as claimed in claim 1 , wherein the step of providing (DIG) 

displacement information (DI) buffers a position and an orientation of the graphics primitive 
(SGP; TGP) of a previous frame to calculate the displacement vector (SDV;TDV). 



PHNL031 141EPS 



24 11.09.2003 

6. A metiiod as claimed in claim 1, wherein 

the graphics system is arranged for displaying pixels (Pi) having a pixel 
intensity (PE) on a display screen (DS), the pixels (Pi) being positioned on pixel positions 
(x,y) in a screen space (SSP), 

the step of sampling (RA; RSS; RTS) is adapted for sampling (RSS) in the 
screen space (SSP) in a direction of a screen displacement vector (SDV) being the 
displacement vector mapped to the screen space (SSP) to obtain resampled pixels (RPi), 

the method further comprises an inverse texture mapping (TTM) receiving 
coordinates of the resampled pixels (RPi) to supply intensities (Rip) of the resampled pixels 
(RPi), 

the step of one dimensional spatial filtering (ODF) comprises averaging (AV) 
-oftheinteisities~^ 

accordance with a weighting function (WF), 

the method farther comprises a resampling (RSA) of the averaged intensities 
(ARIp) of the resampled pixels (RPi) to obtain the pixel intensities (Pli). 

7. A method as claimed in claim 1, wherein 

the graphics system is arranged for displaying pixels (Pi) having a pixel 
intensity (PH) on a display screen, the pixels (Pi) being positioned on pixel positions (x,y) in 
a screen space (SSP), 

the method further comprises providing appearance information (TA, TB) 
defining an appearance of the graphics primitive (SGP) in the screen space (SSP) by defining 
texel intensities (Ti) in a texture space (TSP), 

the step of sampling (RA; RSS; RTS) is adapted for sampling (RTS) in the 
texel space (TSP) in a direction of a texel displacement vector (TDV) being the displacement 
vector mapped to the texel space (TSP) to obtain resampled texels (RTi), 

the method further comprising interpolating (IP) the texel intensities (Ti) to 
obtain intensities (RH) of the resampled texels (RTi), 

the step of one dimensional spatial filtering (ODF) comprises averaging (AV) 
the intensities (Rli) of the resampled texels (RTi) in accordance with a weighting function 
(WF) to obtain filtered texels (FTi), 

the method further comprises: 

mapping (MSP) the filtered texels (FTi) of the graphics primitive (TGP) in the 
texture space (TSP) to the screen space (SSP) to obtain mapped texels (MTi), 
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detennining (CAL) intensity contributions from a mapped texel (MTi) to all 
the pixels (Pi) of which a corresponding pre-filter footprint (PFP) of a pre-filter (PRF) covers 
the mapped texel (MTi), the contribution being determined by an amplitude characteristic of 

the pre-filter (PRF), and 

summing (CAL) the intensity contributions of the mapped texel (MTi) for 

each pixel (Pi). 

8. A method as claimed in claim 6 or 7, wherein at least a direction of the 

displacement vector (SDV;TDV) of the graphics primitive (GP) is an average of directions of 
displacement vectors of vertices of the graphics primitive. 

9_ A method as claimed in claim 6, wherein the step of one dimensional filtering 

(ODF) comprises: 

distributing, in the screen space (SSP), the intensities (Rip) of the resampled 
pixels (RPi) in a direction of the displacement vector (SDV) over a distance determined by a 
magnitude of the displacement vector (SDV) to obtain distributed intensities (DE), and 

averaging overlapping distributed intensities (DK) of different pixels (Pi) to 
obtain a piece-wise constant signal being the averaged intensities (ARPi). 

10. A method as claimed in claim 7, wherein the step of one dimensional filtering 

(ODF) comprises: 

distributing, in the texture space (TSP), the intensities (RE) of the resampled 
texels (RTi) in a direction of the displacement vector (TDV) over a distance determined by a 
magnitude of the displacement vector (TDV) to obtain distributed intensities (TDIi), and 

averaging overlapping distributed intensities (TDIi) of different resampled 
texels (RTi) to obtain a piece-wise constant signal being the filtered texels (FTi). 

\l m a method as claimed in claim 7, wherein the step of one dimensional spatial 

filtering (ODF) is arranged for applying a weighted averaging function (WF) during at least 
one frame-to-frame interval. 

12. A method as claimed in claim 9 or 10, wherein the distance is rounded to a 

multiple of the distance (DIS) between resampled texels (RTi). 
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13. A method as claimed in claim 1, wherein 

the graphics system is arranged for displaying pixels (Pi) having a pixel 
intensity (Hi) on a display screen, the pixels (Pi) being positioned on pixel positions (x,y) in 
a screen space (SSP), 

5 the method further comprises the step of providing appearance information 

(TA, TB) defining an appearance of the graphics primitive (SGP) in the screen space (SSP) 
by defining texel intensities (Ti) in a texture space (TSP), 

the step of sampling (RA; RSS; RTS) is adapted for sampling (RTS) in the 
texel space (TSP) in a direction of a texel displacement vector (TDV) being the displacement 
10 vector mapped to the texel space (TSP) to obtain resampled texels (RTi), 

the method further comprising interpolating (IP) the texel intensities (Ti) to 

obtainintenati^ 



the step of one dimensional spatial filtering (ODF) comprises 
subdividing the displacement vector (TDV) in a predetermined number of 
15 segments 0 to obtain segment displacement vectors (STDV), and for each one of the 
segments 0* 

distributing, in the texture space (TSP), the intensities {xji) of the resampled 
texels (RTi) with a direction, a position and a magnitude according to an associated one of 
the segment displacement vectors (STDV) to obtain averaged overlapping distributed 
20 intensities (TDK) of different resampled texels (RTi) to obtain a piece-wise constant signal 
being the motion blurred filtered texels (FTi), 

the method further comprises for each one of the segments 0= 
mapping (MSP) the filtered texels (FTi) of the graphics primitive (TOP) in toe 
texture space (TSP) to the screen space (SSP) to obtain mapped texels (MTi), 
25 determining (CAL) intensity contributions from a mapped texel (MTi) to all 

the pixels (Pi) of which a corresponding pre-filter footprint (PFP) of apre-filter (PRF) covers 
the mapped texel (MTi), the contribution being determined by an amplitude characteristic of 

the pre-filter (PRF), and 

summing (CAL) the intensity contributions of the mapped texel (MTi) for 

30 each pixel (Pi). 

14. A graphics computer system comprising: 

means for receiving (RA RSS; RTS) geometrical information (GI) defining a 
shape of a graphics primitive (SGP,TGP), 
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means for providing (DIG) displacement information (EH) determining a 
displacement vector (SDV;TDV) defining a direction of motion of the graphics primitive 
(SGP;TGP), 

means for sampling (RA; RSS; RTS) the graphics primitive (SGP; TGP) in the 
direction indicated by the displacement vector (SDV;TDV) to obtain input samples (RPi; 
PJi), and 

means for one dimensional spatial filtering (ODF) of the input samples (RPi; 
PJi) to obtain temporal pre-filtering. 
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ABSTRACT: 



In a method of generating motion blur in a 3D-graphics system, geometrical 
information (GI) defining a shape of a graphics primitive (GP) is received (RSS; RTS) from a 
3D-application. A displacement vector (SDV; TDV) defining a direction of motion of the 
graphics primitive (GP) is also received from the 3D-application or is determined from the 
geometrical information. The graphics primitive (GP) is sampled (RSS; RTS) in the direction 
indicated by the displacement vector to obtain input samples (RPi), and an one dimensional 
spatial filtering (ODF) is performed on the input samples (RPi) to obtain temporal pre- 
filtering. 
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